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ABSTRACT 

The paper discusses several concepts and results in robust adaptive control 
and is organized in three parts. The first pa^ . 'nr\eys existing algorithms. 
Different formulations of the problem and theoretical solutions that have been 
suggested are reviewed here. The second part contains new results related to the 
role of persistent excitation in robust adaptive systems and the use of hybrid 
control to improve robustness. In the third part promising new areas for future 
research are suggested which combine different approaches currently known. 

1. INTRODUCTION 

The stable adaptive control of linear time invariant plants, in what is now 
termed "the ideal case", was resolved in 1980 [1-4], The assumptions made in 
[1-4] regarding the plant to prove global stability are quite stringent. Specifi- 
cally, knowledge of the sign of the high frequency gain K , the relative degree 
n* and an upper bound n on the order of the plant transfe? function are assumed 
to be known. Further it is assumed that the zeros of the plant transfer function 
lie in the left half plane, the plant parameters are constant (though unknown) and 
the system is disturbance free. However, in practice, these assumptions are rare- 
ly met. No actual plant is truly linear, finite dimensional or noise free. Fur- 
ther, in practical situations, the rationale for using adaptive control is to com- 
pensate for large variations in plant parameters. In the presence of such devia- 
tions from ideal conditions, the algorithms suggested In [1-4] no longer assure 
the boundedness of the signals in the adaptive loop. This accounts for the wide 
interest in the past few years in what is termed robust adaptive control to 
achieve satisfactory performance in the prese ce of both mrdeling and operating 
uncertainties. This paper attempts to survey some of the modest gains that have 
been made in this direction, presents some new results for improving robustness 
and discusses promising directions for future research. 

Adaptive systems are special classes of nonlinear systems and many questions 
which arise in such systems can be stated as problems in the stability theory of 
differential equations. In particular, questions of robustness can be addressed 
using amply discussed results cn practical stability and total stability. Since 
such results are bound to find increased application in adaptive systems, some of 
the more frequently used concepts, definitions and theorems are collected in 
section 2. 

Recent years have witnessed many contributions to the robustness problem. 
Among these some assume additional prior information regarding the ur ^rtainties 
to suitably modify the adaptive algorithms [5-9 ] while others assr that the 
reference Inputs possess properties which make the ideal system e k onentially 
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stable. In all cases it is shovm that boundedness of solutions is assured when 
the true situation deviates in specific ways from the ideal. Some of these ana- 
lytical results which are currently known are presented in section 3. 

Sections 4 and 5 contain some new results on persistent excitation and hy- 
brid auaptive control which are relevant to the problem of robustness. In sec- 
tion 4 a nonlinear error equation of second order is discussed in detail. While 
the ideal system is uniformly asymptotically stable it is shown that unbounded 
solutions can result if the disturbance is sufficiently large. It is also shown 
that by increasing the degree of persistent excitation ot the reference input the 
overall system can be made practically stable. Section 5 discusses hybrid con- 
trol algorithms recently introduced by the authors [10]. The same algorithms can 
also be modified to adaptively control discretj plants by updating control param- 
eters infrequently. Some plausible arguments are given towards the end of the 
section as to why such algorithms May be more robust than continuous algorithms 
when external bounded disturbances are present. 

Finally, in section 6, possible vays of combining known methods are discussed 
in the hope that it will stimulate research in these new directions. While no 
hard results exist in these areas the suggestions are based on extensive simula- 
t Lon studies. 


2. MATHEMATICAL PRELIMINARIES AND STABILITY RESULTS 

Some well known concepts and results of stability theory which find frequent 
application in the analysis of adaptive systems are included in this section. 

While they can be readily found in any good text [11-13] we present them here for 
easy reference as well as to place some of the problems discussed in the follow- 
ing sections in proper perspective. We start with the definitions of uniform 
asymptotic and exponential stability of the solution x = 0 of an equation 
i = f(x,t), f(0,t) = 0. We assume that f is continuous and satxsfies conditions 
which guarantee the existence and uniqueness of solutions and continuity of their 
dependence on the initial conditions. The general solution of the dif ferential 
equation is denoted as p(t,x 0> t Q ) with * x o # 

(i) Definition (Uniform Asymptotic Stability): The equilibrium x ® 0 of the 

differential equation x * f(x,t) is uniformly asymptotically stable if it is uni- 
formly stable and for some > 0 and all e 9 > 0 there is a > 0 such that 

|Jx 0 II < Gj implies II p(t,x 0> t 0 ) II < e 2 for all t z t n -1 T. 

(ii) Definition (Exponential Stability): The equilibrium state of the equation 

x « f(x,t) is exponentially stable if two positive constants a and 8 which are 
independent of the initial values. exist such that for sut Lently small initial 
values, ||p(t,x 0 ,t 0 ) || < B|Jx Q ||e"° “ C 0\ 

A linear time-invariant system with f(x,t) * Ax where A is a constant matrix 
is asymptotically stable if the eigenvalue, of A are in the open left Y .If of the 
complex plane. Asymptotic, uniform asymptotic and exponential stability are 
equivalent in this case. For linear time-varying oystems f asymptotic stability 
does not imply uniform asymptotic stability whereas the latter is equivalent to 
exponential stability. For linear systems, all stability properties hold in the 
large. In general, for nonlinear systems exponential stability implies uniform 
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asymptotic stability but not vice versa. If f(x,t) is autonomous or periodic in 
t, all stability properties are uniform. 

In robust adaptive control we are interested in deducing the propertied of 
the solutions of a perturbed system (S ) from the behavior of the solutions of an 
unperturbed system (S) . These are described by the differential equations 

'' ■ f(x,t) (S) ; x * f(x,t) + g(x,t) (S p ) (1) 

Let the equilibrium state of (S) be exponentially stable. If ||g(x,t)|| < L |] x |l 
for sufficiently small b and 6,and|l x |j< 6,then the equilibrium star'* of (S ) is 
also exponentially stable [11]. In physical situations the condition g(0,t? * 0 
required above is not generally met and this gives rise to the concept of total 
stability. 

(iii) Definition (Total Stability) [?1]: The equilibrium state x *■ 0 of (S) is 
totally stable if for every e > 0 two positive numbers 6^(e) and 6^(0) exi3t such 

that every solution p(t,x ,t.) of (S 1 satisfies It p(t,x n ,t-) II < e> t % t. provided 
|* 0 |< .nd*g(x,t) |<°S 2 ? p I' 0 0 0 

In the Russian literature this is also referred to as stability under per- 
sistent disturbances. The uniform asymptotic stability of the >erturbed system 
implies total stability [11] and is frequently used to prove robustness of adap- 
tive systems in the presence of sufficiently small perturbations. Recently the 
magnitude constraint on ||x Q || in the definition of total stability has been relaxed 
by Anderson and Johnstone [8] at the expense of stronger conditions on f(x,t). 


In practical systems we are interested in the uniform boundedness of the solu- 
tions in the presence of perturbations as well as in the magnitudes of this bound. 
This leads to the concept of practical stability defined below. 

(iv) Definition (Practical Stability) [12]: Let * (x|||xH< <5^1 bo open 

set in |R n and 6^ > 0 a constant suph that || g(x r t) |) < 6^ ^ or x an< * c 

If the solutions of (S^) lie within a closed bounded set Q OQq f° r x q e Qq then 
the system (S) is said to be practically stable. 


Total stability assures the existence of and 6^ relative to which the sys- 
tem (S) is oractically stable but provides no way of estimating the size of or 

the magnitude of 5^. In adaptive control applications this is not adequate. One 

is more interested in determining an estimate of Q from a knowledge of 6^* 

An alternative method for treating the effect of pertur tions is by consid- 
ering them as bounded independent functions of time. This leads to the w» 11 known 

concept of bounded input - bounded output (BIBO) stability. 

(v) Definition (BIBO Stability): A system x « f(x,u,t) with £(%0*t) * 0 is 

BIBO stable if for every a s 0 and every a £ 0 there is a 8 * B(a,a) such that 
JI P u <T> VVII - 8 for ail t J tg for every initial condition (x^.t^) with 

*| <- a and 8£p||u(t) |jf a, where P u (V^ 0 »t 0 ) is the solution of the system with 
ir u(*). 
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A linear system x = A(t)x + b(t)u is L' 60 stable if the homogeneous part is 
uniformly asymptotically stable. This is a property which is frequently used ic 
robust adaptive control using the concept of persistent excitation. In contrast 
to the above, uniform asymptotic stability of a nonlinear system does not imply 
BIBO stabilitv. An example of this was given by Deso^r et al [14]. A similar 
situation arises in the discussion of robustness of a second order nonlinear sys- 
tem in section 4. 

Stability Problems in Adaptive Syste j: The study of the stability or adaptive 
systems (as sh^wn in 'the following sections) can be conveniently carried out using 
a set of nonlinear time-varying error differential equations. Even in the 
or disturbance free case the time-variations arise due to the presence of the 
reference input r(«). The following are some noteworthy features of many of the 
stability questions which arise in adapt e systems. 

(i) In the Jdeal case, a Lyapunov function V > 0 with v ^ 0 can be found. The 
negative sem? -definiteness of cannot he avoided and is a resuU. cr the adap*:iv^ 
law used. 


(ii) a result of (i) even the unforced (autonomous) ^ tta is uniformly sta- 
ble. Even when tne reference input is persistently exciting, $ 0 but the system 
can be shown to be uniformly asymptotically stable [15]. We note that LaSalle's 
theorem cannot be directly applied to prove this since the system is nonautonomous. 

(iii) Since the system is exponentially sta. le with a persistently exciting ref- 
erence input, Malkin's theorem can be used to conclude that the solutions will be 
bounded for some initial set and perturbation of magnitude $ 6£. However, very 

little can be said directly about either or 

(iv) Another cc .sequence of the semidefiniteness of V is that assuring even the 
boundedness of solutions using Lyapunov's Direct method for given bounus on per- 
turbations is no longer trivial. Some of these cases are considered in section 3. 
In section 4 it is shown that even v 1 m the reference inpuv is persistently excit- 
ing, if the disturbance is i->cge thfc solutions can be unbounded. Alternately, for 
a given bound on the disturbance the persistent excitation can te made sufficient- 
ly large to assure the boundedness of the solutions. 

3. RECENT RESULTS IN ADAPTIVE CONTROL 


In this sect!* n we attempt to survey briefly some o*. the theoretical results 
currently known ir the area of robust adaptive control. The aim of the section la 
to provide an understanding of the qualitative idea*, that led to these result* a * 
well as the analy ical tools used in deriving them. Since the ideal system lorms 
the starting point of all perturbation a.i^lyses, we shall .brief ly outline the 
statement of the problem and the proof of stability in chis case. Further, while 
several stable adaptive algorisms have been suggested in the literature, we shall 
discuss the proof of stability using only a algorithm proposed in [16]. The 
proofs using all the other algorithms follow along similar lines. 


a) Ideal System ; The plant to be controlled is described by the ?"ate equations 


Ax + b u 
P P P 


r r 

y * c 
p p p 


( 2 ) 
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and a reference menial is described by 


• T 

x = A x + b r ; y » c x 
m mm m m mm 


( 3 ) 


where k , u and y are respectively the state input and output of the plant and 

x an« ? y_ are P the state anu output of the model. The transfer functions of 
m m * 

the plant and model are 


K 2 (s) 

W (s) * c (sI-A ) b = r 

P p p p n ,8) 

The following assumptions ai r ide regarding W (s) and W (s) 

p m 


T -1 

k (8) * c (sI-A ) b » 
m m a m 


*m 


R (s) 

m 


(i) Z (s), R (s) and t< *) are moric polynomi Is of degrees m, n and n*=n-m 
P P * 

(ii) Z (s) and R (s) ai*. . tric^ly seable polynomials 
p m 


and (iii) r is a piecewise continuous uniformly bounded reference input. 


The objective is to co^tr^l rhe plane in such a fashion that the output error 
between plant and model e^ * tonds to zero asymptotically, while the sig^ 

nals and parameters of the system remain uniformly bounded. It is now well known 
that knowledge of the exact relative degree n* of the plant, an upper bound n on 
its order, the sign of the gain and the condition that Zp(s) be Hurvitz as 

given in v ii) are needed to solve *he problem, n* enables the model to be con- 
structed while the value of n determines the order of the controller to be used. 
The sign of K and the constraint on Z (s) are needed to prove the stability of 
the overall system. ^ 

Structure of Controller : In the following we shall assume that K is known and 

K * K * 1. To meet the control objective a controller describeB by the follow- 
p m 

ing equations is used: 

; (1 > = Fw (1) + gu ; J> (2) - Fu/ 2 ^ + gy p ; U - e T w + r (4) 

where F is an asymptotically stable nxn matrix, (F,g) is controllable, 

T T 

T (1) (2) 

id * [id ,tu ] and 0(t) is a 2n dimensional parameter vector which is to be 
adjusted adaptively. It Is well known [17] that a unique constant vector 0* 
exists such that the transfer function of the plant together with the controller 
matches that of the model exactly, when 0(t) = 0*. The aim of the adaptive law 
is to adjust 9(t) in such a meaner that the overall system is globally stable and 
lim e (t) ■ 0. 
t-*» 1 

While several special cases of the adaptive control problem have been con- 
sidered, we discuss below the general case when W^(s) has a relative degree 

n* > 2. If 0(t) - 0* « $(t) , then <p is the parameter error vector and the output 
of the plant can be expressed as 

y (t) =* W (s)[r(t) + <j> T (t)u)(t)] (5) 

p m 
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The Adaptive Scheme ; To generate the adaptive law an auxiliary error signal y (t) 
is added to e^(t) to generate an augmented error e^(t). If & 


y (t) = ie T (t)w ( S )i - w (s)e T (t)]u>(t) 

a mm 


( 6 ) 


then 


4> T (t)C(t) = e^t) + y fl (t) = e^t) (7) 

where W (s)lu = £• The adaptive law for updating 0(t) then depends on the aug- 
mented error e (t) and the signal £(t) and is given by 

- e |(t)C(t) 

♦ (t) = 9(t) ^ (8) 

1 + C (t)C(t) 

This has been shown to result in global stability of the adaptive loop [16]. 

T 

Proof of Global Stability : If V($) ** 1/2 $ the adaptive law (8) yields 

V(+) - i 

1 + C (t)c(t) 

from which it follows that 

(i) <f> and $ are uniformly bounded 

(ii) ♦ e L 2 (9) 

and (iii) El (t) - v(t)tl + c T (t)c(t)] 1/2 . v e L 2 

Since the complete proof is too long and involved to be included here in its 
entirety we merely outline the principal steps involved. 

(a) Since the parameter vector is bounded by (i) it is first shown that 

supjy (x) j ^ sup ||u/ 2 ^(t)|{ * sup ||i*>(t)|| ^ sup lU(x)B (io) 

Tit P Tit Tit Tit 

Here 'v is an equivalence relation and Implies that the corresponding signals in 
(10) grow at the same rate [18]. 

. 2 

(b) Since ^ c L it can be shown that y (t) grows at a slower rate than 

a 

sup |u(t)Q denoted by y (t) * o[sup (u>(t) g ]. (11) 

tit a Tit 

(c) From (5) , (9-iii) and (11) it follows that 

e - W <|> T w * v[l + C 1 1 ^ 2 + o[sup ||<d(t)|| ] (12) 

1 “ 2 Tit 

(d) Since v e L using equation (4) we conclude that 
sup|| u/ 2 ^ (t) || ■ o sup || ci>(t) || which contradicts (10). 

Tit Tit 

Hence all the signals in the system are uniformly bounded and lim e^(t) * 0. 

t-HJO 
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The importance of demonstrating the boundedness of $(t) and ^ e [ in the 
proof of stability is worth noting. [In some cases it may be possible to show 
that lim $(t) = 0, which serves the same purpose.] The former assures that the 

t-*» 

relevant signals in (10) grow at the same rate while the latter is used to prove 
that |y (t)| and Jj || should grow at different rates if the adaptive control 

is used, leading to a contradiction. 

Asymptotic Stability of the Ideal System ; Once the boundedness of all the signals 
in the adaptive system has been established, interest shifts to the convergence 
of the parc'seter vector 0(t) to its desired value 0* or equivalently of <fr(t) to 
the null vector. Since the adaptive law (8) can be represented as 

i(t) - - (t) — *(t> d3) 

1 + C (t)c(t) 

the conditions that have to be imposed on c(t)'to accomplish this is of interest. 
Following the results of Morgan and Narendra [19] if £(t) is persistent- 

/1 + c T (t)c(t) 

ly exciting lim <fr(t) * 0 and the convergence is exponential. Since W (s)Ioj * 5 , 

t-H» m 

a sufficient condition for £(•) to be persistently exciting is that w(*) is per- 
sistently exciting [15]. Hence conditions under which <*)(•) will be persistently 
exciting have been investigated by several authors [15,20-22]. 

Persistent Excitation (PE) of qj(t) and u)*(t) : Early results on the convergence of 

the parameter vector to the null vector were stated in terms of the PE of co(t). 
However since ui(t) is a dependent variable within the adaptive loop, very little 
can be said directly about its persistent excitation. Hence attempts were made to 
express this condition in terms of the PE of signals in the model which are at the 
discretion of the designer. Since the adaptive system and model transfer functions 
are identical when 0(t) = 0*, the model can be parametrized in such a fashion that 
a signal u* in it would correspond to the signal u>(t) in the adaptive loop. Fur- 
ther since the model is time Invariant, conditions on r(t) which would assure the 
PF of w*(t) can be derived* If w(t) ■ u>(t) - to*(t), the adaptive law assures that 
lim w(t) = 0. Hence, in the ideal case the PE of w*(t) ensures the PE of w(t) 

t-H» 

and hence the convergence of the parameter vector 0(t) to its true value. 

Comments : 

(i) The above arguments have focussed attention on several interesting ques- 
tions related to persistent excitation and transformations -under which the proper- 
ty is preserved [15]. 

(ii) The convergence of «(t) to 0 is used above to show the PE of co(t) and hence 
the convergence of $(t) to 0. This is no longer possible when an external dis- 
turbance is present since even the boundedness of the signals is not assured in 
such a case. 

(iii) From the results of several authors it is now known that an almost periodic 
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reference input with n-distinct frequencies results in the PE of u)(t). 

b) Adaptation Under Perturbations : The adaptive control system described in sec- 

tion (3a) assumed ideal conditions* The plant was linear and time-invariant and 
no external disturbances were present* In addition, considerable prior knowledge 
of plant transfer characteristics was assumed to help in setting up a reference 
model and deriving stable adaptive laws. As mentioned earlier, plants are rarely 
strictly linear or finite dimensional and in many practical situations the need 
for adaptive control arises due to large parameter variations* Also, external in- 
put and output disturbances are invariably present in real systems* Hence there 
is a definite need to extend the theory developed for the ideal case to situations 
with modeling errors and external disturbances* Some of the schemes that have 
been proposed in recent years to achieve robustness in the presence of such per- 
turbations are briefly reviewed in this section and some new results are reported 
in sections 4 and 5* 

The basic adaptive system in the ideal case is only uniformly stable* This 
implies that bounded perturbations can theoretically produce unbounded outputs* 
When the reference input is persistently exciting, the nonlinear system is uni- 
formly asymptotically stable in the large and exponentially stable when the ini- 
tial state Xq lies in a finite ball around the origin* The latter fact allows 
BIBO results to be derived using theorems cf the type described by Malkin, pro- 
vided the perturbations are sufficiently small* However, as pointed out in sec- 
tion 2, very little can be said using such an approach about the effect of bounded 
perturbations of a specified maximum amplitude on the global behavior of the solu- 
tions of the adaptive system* In addition to such perturbation methods a few 
global methods have also been used to derive results in robust adaptive systems* 
The principal concepts involved in deriving some of these are discussed below* 

(i) Use of Dead-Zone {5] : The problem statement is similar to that given for the 

ideal system with the exception that y * c ^x + v, where v, is a bounded dis- 
7 P P P 1 1 

turbance. Using the same adaptive law (8) as in the ideal case, the error equa- 
tions can be expressed as 

♦ T (t)c(t) + v(t) - e(t) (14) 

and 

$(t) * (adaptive law) 

1 + t (t)Tt(t) 

where v is an equivalent output disturbance due to v- . The difficulty arises due 

T 1 T 

to the presence of v(t) in (14). When sgn[$ £ + v] * sgn[4> £] the adaptation is 
in the right direction. Otherwise the parameter vector may be adjusted away from 
its desired value. This implies that problems of convergence may arise when e(t) 
is of the order of the vound V- of v(t). The modification in the algorithm sug- 
gested in [5] is to use a dead-zone so that the adaptive parameters are not ad- 
justed when e(t) lies inside it* Hence the overall system operates in two modes — 
a linear time- invariant mode when |e(t)| £ v 0 + ® (for some constant 6 > 0) and 
an adaptive mode otherwise. In [5] It is shown that such an algorithm results in 
a system with bounded signals* Further, adaptation takes place for only a finite 
time* This implies that in practice the system will converge to a linear time- 
invariant system in a finite time after which the output error will lie entirely 
in the dead-zone and hence adaptation ceases entirely. 
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(ii) Bound on H 6* jj : An alternate approach to the bounded disturbance problem 

was taken by Kreisselmeier and Narendra [6], While the statement of the problem 
as well as the structure of the controller are identical to that in (i), it is 
assumed that no knowledge of a bound on the disturbance is available. Instead, 
it is assumed that the desired vector 0* has a norm less than a specified value 
M 0 *Hma X * Hence the search procedure can be confined essentially to the set 

S: < 6 ! U°U ‘I 0* Hmax^* 1116 ada P tive law used t0 update 6(t) is identical to that 

in the ideal case when 0 lies in the interior of S and is modified when it reaches 
the boundary of S, or lies outside it. In [6] it is shown that such a scheme re- 
sults in the boundedness of all signals in the system. 

Apart from the obvious differences between the schemes suggested in [5] and 
[6], there are mathematical differences in the proof that are worth stressing. 

As in [1-4], the proofs of stability in [5] use limiting arguments as t + * to 
show that $ e Such a procedure cannot be used in [6], since $(t) does not 

tend to any limit as t -*• «. Hence all arguments are based on the analysis of the 
behavior of the systea over a finite interval. As shown in section 6 the approach- 
es in (5] and [6] complement each other and can be .. ombined to have wider applica- 
tion in adaptive systems in the future. 

(iii) The o-modif ication Scheme ; In approaches (i) and (ii) certain prior infor- 
mation is assumed to implement the adaptive laws. In contrast to this, a scheme 
suggested by Ioannou and Kokotovic [7] assures boundedness of all signals in the 
system, without any assumptions regarding the bounds on either the disturbance or 
the control parameters. However, to the authors' knowledge, the method has been 
shown to result in global boundedness only for the special case when the refer- 
ence model is strictly positive real. 

The method is based on the following simple ideas. If V(e,$) is a quadratic 
Lyapunov function candidate, the time derivative $(e,$), along a trajectory, is 
generally a quadratic function of e and hence is negative sem^def inite . When^a 
disturbance is r resent, V(e,$) has the general form -e L Qe + e av, where Q * Q > 0, 
a is a constant vector and v is a bounded disturbance. Very little can be con- 
cl*. led regarding stability from this and accounts for the modifications suggested 
in [5] and [6]. In [7], an additional term -o0 is used in the adaptive law, as a 
result of which V(e,$) becomes negative definite outside a bounded region in the 
(e,<(>) space. From this it is concluded that all signals in the system are bound- 
ed. 

(iv) Adaptive Systems and Time-Varying Plants : The methods outlined in sections 

3b(i-iii) deal with the global behavior of the adaptive systems when bounded per- 
turbations are present. In contrast to this Anderson and Johnstone [ 81 examine 
adaptive control problems where the assumptions made regarding the system deviate 
slightly from the ideal. While [ 8] addresses primarily the problem of time- 
varying plant parameters the authors claim that the same methods with remarkably 
little change allow examination of the effect of measurement noise, plant nonlin- 
earity and undermodelling of the plant order. 

As in our discussions in section (3a), the authors first consider the ideal 
system and demonstrate uniform or exponential stability in the presence of per- 
sistent excitation. For the various types of perturbations considered, their aim 
is then to show that the resulting equations can be cast in such a form that the 
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total stability of the overall system can be demonstrated using modifications of 
Malkin s theorems* however, as mentioned earlier, the theorems are useful primar- 
ily for establishing *he existence of robustness in the presence of sufficiently 
small perturbations rather than for providing guidance in the choice of the con- 
trol input to assure boundedness of solutions when the class of perturbations is 
specified. 


4. PERSISTENT EXCITATION AND ROBUSTNESS 


In the last section, we discussed two approaches of studying the robustness 
problem in adaptive systems* The approach in 3-d assumed that the perturbations 
were sufficiently small and derived BIBO results local in nature, using Malkin's 
theorem, whereas in 3a-3c the approach was global in nature and used additional 
information regarding plant dynamics and the external perturbations* Also, the 
first approach made use of the PE of the reference input which was not needed in 
the second* 

In this section, we present some new results which demonstrate global bound- 
edness of all signals in the adaptive system in the presence of bounded disturb- 
ances when the reference input is sufficiently persistently exciting. We show 
that by analyzing a set of nonlinear error differential equations, we can estab- 
lish the global robustness behavior of the adaptive systems* In particular, it is 
shown that if the persistent excitation of the model output is larger than the 
disturbance, the solutions will be globally bounded and that if the maximum ampli- 
tude of the disturbance is greater than that of the model output, the system can 
have unbounded solutions* The basic idea is stated here by considering the adap- 
tive control of a first order plant and studying the corresponding second order 
nonlinear differential equations in detail* The same methodology is 
applicable to the general adaptive control problem* 


Nonlinear Error Equations : The plant to be adaptively controlled, the correspond- 

ing reference model and the resulting error equations are as follows: 


Plant: 

Model : 

Error Equations: 
Adaptive Law: 


m 


ay + u + v: u 

p p 

-y + r 


0y + r 
P 


e l " ' e l + % + v 

♦ " -Vp 


(15) 


where r is the reference input, v is a bounded input disturbance, e^ is the output 

error defined as e, * y - y and 6 is the parameter error. In the ideal case, 

1 ^p 'm T 

when v(t) = 0, by considering 


e^t) - -e^t) + $(t)y p (t) 
$(t) * -e 1 (t)y p (t) 


(16) 


it immediately follows that the system is uniformly stable and if y (t) is per- 
sistently exciting, the system is exponentially stable. When a ^ disturbance 
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v(t) is present, it is tempting to proceed as in the ideal case and require y (t) 
in (15) to be persistently exciting so that the unperturbed system is expo- ** 
nentially stable resulting in a bounded error vector for bounded perturbations. 
Since stability of the overall system has not been established, y (t) cannot be 
assumed to be bounded and proving that it is PE becomes specious,* 5 Hence we have 
to express the right hand side of (15) in terms of the model output y (t) which 
is an independent variable rather than the dependent variable y (t), ihis results 
in the following nonlinear error differential equations: ** 

e (t) = -e (t) + <j>(t)y (t) + *(t)e (t) + v 

1 2 U7) 

$(t) = -e (t)y (t) - e (t) 
l m 1 

By analyzing the above nonlinear differential equation, we demonstrate the global 
behavior of the adaptive system in the presence of v(t). 


The Idea] System : In the absence of external- perturbations, the nonlinear system 

(18) 


e (t) = -e (t) + <Kt)y (t) + $(t)e (t) 
it m l 


<J>(t) = -e. (t)y (t) - e (t) 

1 m 1 

can be shown to be uniformly asymptotically stable in the large as follows: If 

12 2 2 
W(e^,$) « y [e^ + <(> ] , the time-derivative W[e^,<J>] * -e^ < 0, Hence the system 

e,(t) and <f>(t) are uniformly bounded for all t > t n , if W[e- (t n ) *4>(t n ) ] < 00 . 

1 2 * -UlUO 21 

Since e^ e L and e_ is bounded, litn e (t) * 0. The nonlinear vector [<(>e ,-e^ ] 

t~H» 

can be considered to be the input to the linear part which is exponentially stable 
if y m (t) is PE, As e^ 0 as t -► ®, this input tends to zero and hence x(t) + 0 

as t + ® where x = [e^,4>]^. Since all the arguments ere independent of the init- 
ial time tg and the magnitude of the initial conditions, the system is u,a.s,l. 

It is also worth noting that when y^(t) is PE, the linear part of (18) is expo- 
nentially stable but the nonlinear system is exponentially stable only when the 
initial state x(t n ) lies in a finite ball around the origin and not globally ex- 
ponentially stable. 


Perturbed System : To provide some insight into the behavior of the nonlinear sys- 

tem, we shall discuss three cases where the perturbed nonlinear system (17) is 
autonomous. 


Case (i) y (t) = 0: When v(t) = 0, th^ system is uniformly stable. If v(t) = v , 

m max 

lim <j>(t) =* -oo and lim e (t) * 0. 

t-Kr t-HX> 

Case (ii) y (t) = y : The unforced system in this case is autonomous and, by 

m max 2 

LaSalle’s theorem, is u.a.s.l. since the largest invariant set in E * {x|e, « 0} 

is the origin. However, since the system Is nonlinear, it no longer follows that 
a bounded input will result in a bounded output. If, for example, v(t) = -v , 
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where v > y , we can show that lim e„ (t) = -y and lim d>(t) = 
max max ^ l v 7 7 max T 

t-x» t-*» 

Case (iii) y (t) = y ,y > v : The system is Lagrange stable. When 

m 7 max max max J v & 

v(t) = -v , the system has an equilibrium state at (0, —2^- ) which is 
max v 

max 

u.a.s.l. Similarly when v(t) = v max » the system has an equilibrium state at 

( 0 , - ). 

^max 

The above special cases reveal that the behavior of the nonlinear system is 

very much dependent on y and v .In particular, when y (t) = y and 

max max m max 

v(t) = -v , the system has unbounded solutions when v > y and all solu- 
. max, . , , „ max max 

tions are bounded when y > v The results also carry over to the general 

max max J 

case when both v(t) and y (t) are time-varying and are stated in the following 
main theorem of the paper? (Fig. 1) 


Theorem l:Let |y (t) | < y , |v(t) | 
* 1 m - max 1 1 


* v and y (t) be a smooth persistently ex- 
— max m 


citing signal in the sense described in [23]. This implies that positive numbers 

T ,e and 6 exist such that given any t 1 > 0, there exists a t 0 e [t ,t + T ], 

U U U i 1 , t Z 11 u 

] and — I 2 0y (x)dx| > e . Then 

T o Jt„ m - 0 


with U 2 ,t 2 + 6 q ]C + T Q 


(a) If v 


max 


< v max * by choosing an input v(t) as 


v(t) =* -sgn(y (t))v when I e- ( t) I > y 

® max 1 1 1 — 'max 

■ sgn(e-(t))v |e-(t)| < y 

”1 max 1 1 1 J max 

where sgn(a(t)) * r /IT T when a(t) f 0 and is equal to unity when a(t) » 0, there 

1 3. ( 1 ) I 

exist initial conditions for which lim $(t) = “°° and e^(t) approaches asymptotic- 

ally the region |e^| < Y max + e » where e is an arbitrary positive constant. 

(b) If > v max + ^ where 6 is any arbitrary positive constant, then all the 
solutions of the differential equation (17) are bounded. 


Proof ; 

a) Let be the open domain enclosed by the line e^ » -v^ and the curve 
e + v 

<f> m — with < 0. When y (t) = y and v(t) * -v all solutions 

1 max 

that start on the boundary d(D^) enter D^. Since the system is autonomous and 

contains no singularities in D fall solutions originating D- are unbounded and 
lim d>(t) “ -«>, lim e 1 (t) * -y 

t~H» t-+°° 

For a time-varying signal y (t) the proof of unboundedness is related to the 
above autonomous case. Consider ro the solution of the differential equation with 
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- V 


initial condition ( 0 > 4 >q) with 4 >q < ^ 


max 


max 


> with y (t) = y and v(t) = -v . 

m 4 * * 7 max v max 


Let r + denote the open curve along which the trajectory lies for all t 5 0. Simi- 
larly let r_ denote the curve along which the solution lies for all t * 0 when 
v(t) = v max ”and y(t) = -y^. Let r(<*> Q ) = r + U T_. r(* Q ) divides the plane into 

two open regions D 2 and D 2 ° where (0, <#>) e D 2 if <p < <p Q . Then all solutions of the 

differential equation with |y m (t) | $ and |v(t) | $ v with initial conditions 


on r(<{> 0 ) lie either in I (<f> 0 ) or enter D 2 « Since this is true for every <j> 0 » the 

solutions are unbounded and lim <J>(t) = 

A T t ' H ” 2 

b) Let x = Let D denote the region in ft D#{x||e..| < v } and let 

^ t ij 1 — max 

D denote the complement of D. If W(x) * 1/2 x x, the time derivative of W along 

a trajectory is W(x) = - e ^ + e^v < 0 for x e D C . Hence ||x || decreases in D C and 

can increase only in D. We wish to show that a constant c exists so that if 

lino'll " C 1 1 c over an interval [t Q ,t 0 + T Q ], then||x(t Q + T Q )|| < c^ 

If |Jx( tQ>|| » Cq, integrating the equation for e^ in (17) it can be shown that 
D, then j 
2 [ T + 1] 


C fnov 

if x(t Q ) e D, then x^) e D for some ^ e [t Q ,t 0 + T Q ] if c Q > , where 


cot 6 = 


(e -v )T 
0 max 


Hence under the conditions specified in the theorem, the 


trajectory invariably enters D during every period Tq. By increasing 

monoconically, the trajectory can be made to lie in a subdomain of D C for a finite 
time A with 0 < A < 6_ over every period. Since ||x(t)| decays exponentially in 
this subdomain, a constant c > c^ exists satisfying the conditions of the theorem. 

Comments :j. The positive limit set of any solution x(t) lies in D. 

2. Cq will be referred to as the degree of persistent excitation. By the theorem, 
the solutions are bounded if e_ > v but the nature of the limit set depends on 

V ‘o - V 0 “ 

3. From the theorem it follows that for a given bound v on the perturbations, 

the system can be made robust by increasing the degree max of persistent excita- 
tion. Note that this is an example of practical stability. 

4. The conditions for boundedness and unboundedness of solutions are given in 
this case in terms of y (t). For design purposes it is more appropriate to ex- 

press them in terms of m the reference input r(t). 


HYBRID ADAPTIVE CONTROL 


In continuous adaptive systems of the type described in the previous sections, 
the plant operates in continuous time and the controller parameters are adjusted 
continuously. Recent advances in microprocessor and related digital computer tech- 
nology favor the use of discrete systems in which signals are defined at discrete 
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instants. Practical systems on the other hand may contain both discrete and con- 
tinuous elements. Such systems may be described as hybrid systems. In a recent 
report [10] the authors have developed analytical models of hybrid ystems in 
which control parameters are adjusted in discrete time even as the continuous 
plant signals are processed in real time. The same algorithms can also be extend- 
ed to control disci ete time plants so that the overall discrete system operates 
on two time scales - a fast time scale in which the system operates and a slow 
time scale in which the control parameters are updated* We shall refer to such a 
system as a discrete hybrid system* 

In this section we describe briefly one of the hybrid adaptive algorithms and 
demonstrate global stability in the ideal case of an adaptive system which uses 
such an algorithm. The behavior of a discrete hybrid system is then discussed 
when bounded external disturbances are present* Using the results of the previous 
section , arguments are put forward as to why hybrid schemes should result in more 
robust systems and simulation results are presented to show that this is indeed 
the case* 


a) Hybrid Error Model : In this section we consider the first of several hybrid 
error models given in [10] and discuss its properties* Similar results can also 
be derived in all the other cases* The error model Is described by the equation 


<j> k u(t) = e^t) 


C e 


k e N 


(19) 


where u: JR + |Jt ra , e_: |R + are piecewise continuous functions which are refer- 

red to as the inputand output functions of the error model* {t, } is a monotonic- 

+ k 

ally increasing unbounded sequence in [)R with 0 < ^ ^ S ^max < °° ^ or k e ** 

where - t^. When T^ * T, a constant, we shall call T the sampling peri- 
od. 4> : is a piecewise constant function, referred to as the parameter 

error vector and assumes values <$>(t) « 4^, t c where $ is a constant 

vector* 


It is assumed that (and hence is unknown, the values u(t) and e^(t) 

can be observed at every instant t and ^ ^ can ac *justed at 

t * t. + .« The objective is to determine an adaptive law for choosing the sequence 
{ A<(>- } using all available input-output data so that lim e (t) ■ 0* 
k t-K* 1 

Theorem 2 : If in the error equation (19) the vector is updated according to the 
adaptive law t. t - 

k+1 e. (t)u(t) 

£ dx (20) 

- \ 1 + u (t)u(t) 

then 



(D 

(ii) 


if u(t) and u(t'> are uniformly bounded in |R lim *^(t) * 0 

if in addition to the conditions in (i) u i* persistently exciting over an 

interval T . , lim 6 . * 0 
min , r k 

k-H» 
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°o T 1 / 2 2 

(iii) If u e L then e^(t) = p(t)[l + u u] , p e L . 

IT 11 

Proof : If V(k) - y ^ using the adaptive law (20) we obtain AV(k) * “ y ^k 

f 21 - < 0 

i r k+1 /■ x t, , 

where R, = f . < x) dt . 


fc k 1 + u^(x)u(t) 


Hence V(k) is a Lyapunov function and assures the boundedness of $ . Since 


Z AV(k) < <*> it follows that lim AV(k) = 0. Hence 
k=l „ k-H*> , f t 


U„ * \» k - lim A- 

k-*» k-H» k 


k+1 


e x (r) 


dt = 0. 


t fc 1 + u (t)u(t) 

(i) If u is bounded, e^ is bounded and e^ e . If u is bounded lim e^(t) = 0. 

(ii) If u is persistently exciting is uniformly positive definite and hence 

<(>k 0 as k -> <». 

OO r - <— » »!■■— 2 

(iii) If u grows in an unbounded fashion with u e L , e- * p/.. . T where pel* 

" e 1 1 + u u 


Comments : In the three cases given in theorem 2 the first two assume that the 

input u is uniformly bounded and the corresponding results are applicable ) the 
identification problem. The third case which treats unbounded inputs is applic- 
able to the control problem. 


The fact that T^ need not be a constant is also worth noting. As shown in section 
6 a time-varying period may be used to improve the transient response of the sys- 
tem* 


b) Stable Hybrid Adaptive Control - Ideal Case : The hybrid adaptive algorithm 

described in the preceding section can be used to adjust the control parameters 
of a hybrid adaptive system. Using an approach very similar to that used in sec- 
tion 3 for a continuous time system the overall system can be shown to be globally 
stable o Using the same notation as in section 3 we have for the adaptive law 

, (^k+l e 1 (T)c(x) 

A *k T~ lt ~ T dT 

k ^k 1 + C (t)c(t) 

From the analysis in the previous section we conclude that 


(i) the parameter error vector is bounded 

' *j» 2 

and (ii) e^-p/l+cc where pel, 

whi^h conditions are the same as those ohtained for the continuous case. Condi- 
tion (i) assures that the signals y^, ui ^ , ||u(t)|| and|^(t)j| grow at the same 

rate. Condition (ii) results in |y (t) j ** o sup||co(t)|| which contradicts the pre- 

p r 

vious assertion proving the boundedness of all the signals. 

The similarity between the continuous and hybrid systems also extends to 
cases when external bounded disturbances are present and the methods described in 
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sections 3 and 4 apply to the hybrid case as well. However, as shown in the fol- 
lowing section, the use of averaged values over an interval rather than instant- 
aneous values, results in more robust control. 

c) Adaptive System with Two Time Scales : The hybrid adaptive algorithm developed 

in section 5a and applied to hybrid adaptive systems in section 5b can also be 
s>’ ‘ modified for discrete hybrid systems or discrete systems with two time 

. es, shown below. 


Let the output error e^(k) e IR^ and the parameter error vector $(k) e fR n be 
related by tne error equation 


<t> (k)w(£) = e^O 


k,£ e N, £ e[kT,(k+l)T] 


( 21 ) 


where <J>(k) is a constant vector over the interval [kT, (k+l)T] , T e N and denotes 
the period of the interval and w(£) e (R is an input vector. Using information 
collected over the entire interval, the parameter error vector $(k) is updated at 
time (k-fl)T using the adaptive law 


. (k-fl)T-l e. (i)w(i) 

♦ <k+l) - 4>(k) = A4> (k) = - 1/T E 

i-kT 1 + w(i) w(i) 


where R(k) = 1/T 


(k+l)T-l 
E 
kT 


- R(kH(k) 

w(i)w(i) T 
1 + w(i)^w(i) 


( 22 ) 


In [10] it is shown that V(k) * 1/2 (J> (k) (k) is a Lyapunov function for the 
system (21) from which it follows that $(k) is bounded if $(0) is bounded and 


e.(i) 

lim T lj2 

i-Ko [l+w(i) w(i)] 


i e N 


(23) 


If the adaptive law (22) io used in a control system to update the parameters, 
equation (23) can be used to demcnstrate global stability [10]. 


When an external disturbance v is present the error equation (23) have to be 
modified as 


4> T (k)w(£) + v(£) = e 1 (£) £ e[kT,(k+l)T] 


(24) 


Using the same adaptive law as before, the error equation has the form 

(k+l)T-l ... ... 

A$(k) = -R(k)<J>(k) + E "( . ^ (i) 

i-kT 1 + w(i) w(i) 


(25) 


where s(k) 


(k+l)T-l 

E 

i=kT 


- -R(kH(k) + s(k) 
w(i)v(i) 


1 + w(i) f w(i) 


The matrix R(k) and the vector s(k) in algorithm (25) are averaged values 
over an interval rather than instantaneous values. Hence the equivalent system 
may be considered to have more persistently exciting inputs in its homogeneous 
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equation and a smaller magnitude of perturbation (if the mean value of the dis- 
turbance is small). Due to both reasons the outputs tend to be smaller. Simula- 
tion results shown in Fig. 2 indicate the dramatic improvement in performance. 

6. NEW DIRECTIONS 

The criteria for judging the performance of an adaptive control system are 
no different from those used for any conventional control system and include sta- 
bility speed and accuracy of response. In the preceding sections methods using 
persistent excitation of reference input, and nonlinear and hybrid adaptive algo- 
rithms were described which would make the overall system stable under perturba- 
tions. A judicious combination of these different methods may improve the robust- 
ness of the system substantially and result in schemes which are practically at- 
tractive. Some of these combinations as well as extensions of known methods which 
appear promising are given below. 

(i) Robustness of n^* 1 Order System Using Persistent Excitation : A detailed analy- 

sis of a first order adaptive system containing a single control parameter was 
giverv in section 4. When a disturbance Is present it was shown that a sufficiently 
large persistently exciting reference input would also result in bounded solutions. 
Further studies have revealed that similar conclusions can be drawn regarding 
higher order systems and research is currently being done to determine the bounds 
on the solutions, 

(ii) Hyb rid Adaptive Control : In the adaptive control system described in sec- 

tion 5, it was shown that the sampling interval T could itself be time-varying 

provided it lay in a bounded interval [T . ,T ] with T . >0. In practical 

min ma x min 

systems It appears possible to adjust T, on line to improve the transient response 
of the - n. 

(iii) eavi-Zone, Persistent Excitation and Plant Identification ; A sufficiently 
large dead-zone in the adaptive algorithm was shown to result in bounded solutions 
in section 3 C The results in section 4 indicated that boundedness of solutions 
could also be achieved by increasing the PE of the reference input. It therefore 
appears likely that the same results can be achieved using a combination of a 
smaller dead -zone and a smaller degree of persist' excitation. Simulation stu- 
dies have shewn that this is indeed the case and aL<.empts are being made to demon- 
strate this theoretically. 

When the reference input is persistently exciting and the adaptive loop Is 
stable, the plant parameters can be estimated on-line and used in second level 
adaptation to reduce the dead-zone further. Hence combining a dead-zone with PE 
of reference inputs appears to be oi both theoretical and practical interest. 

(iv) II 0* II and Persistent Excitation: . , ... , 

M 11 max As in (iii) a persistently exciting in- 

put enables 0* to be estimated and hence an attempt could be made to use ths infor- 
mation to decrease the region of search. 

(v) cr-modif ication and Persistent Excitation : The o-modif ication scheme, in its 

basic form, described in section 3 is unappealing, since the parameter error can 
be large if || 6*|| is large. Using identification methods as in (iii) and (iv) and 
estimating 0* on line, second level adaptive procedures may result in a smaller 

bias* 
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The second level adaptation problems stated in (ii)-(v) while practically at- 
tractive, lead to stability questions in more complex nonlinear systems. Further, 
it is worth pointing out that all of them consider external disturbances rather 
than perturbations in plant dynamics. The reduced order problem which deals with 
the design of a low order controller to adaptively control a higher order plant is 
generally agreed to be the single most important theoretical question in the field 
of adaptive control. While considerable research is being carried out in this 
area, it is acknowledged that even a proper formulation of this problem is a form- 
idable one. It is felt that the answers to some of the questions raised in this 
section will contribute significantly towards this end. 
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Fig. Is Persistent Excitation 
and Robustness. 


(a) autonomous case |y m |<|v| unstable 

(b) autonomous case |y_| > | v l stable 

(c) non-autonomous case y < v unstable 

' •'max max 

(d) non-autonomous case e A > v stable 

0 max 


194 


















wry lawtaae (kf,(M)T) 

♦ T (k) - (♦ u .4 lk ! •*(*) - T • 

ri|. l 


Fig. 2: Improved Robustness Using Hybrid Control 
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